Optimizing Hartree-Fock orbitals by the density matrix renormalization group 
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We have proposed a density matrix renormalization group (DMRG) scheme to optimize the one- 
electron basis states of molecules. It improves significantly the accuracy and efficiency of the DMRG 
in the study of quantum chemistry or other many-fermion system with nonlocal interactions. For a 
water molecule, we find that the ground state energy obtained by the DMRG with only 61 optimized 
orbitals already reaches the accuracy of best quantum Monte Carlo calculation with 92 orbitals. 
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I. INTRODUCTION 



Theoretical investigation of correlation effects beyond 
the Hartree-Fock approximation has long been a chal- 
lenging problem in the study of quantum many-body 
physics. It encounters a number of intractable problems 
even in the calculation of a helium atom.^ The difhculty 
arises mainly from two respects. One is the approxima- 
tion, for example the Hartree-Fock approximation, that is 
used in selecting the one-electron basis states (i.e. molec- 
ular orbitals) from a truly infinite basis set. The other 
is the approximation that is used in further determining 
the many-electron wavefunction. The full configuration 
interaction can treat the many-body correlation rigor- 
ously. However, the number of orbitals that can be han- 
dled by full configuration interaction is small 3 In practi- 
cal calculation, certain approximations, for example the 
truncated configuration interaction or the coupled cluster 
expansion methodj^i^ have to be taken. 

Recently, the application of the DMRG (Ref.Q) 
has attracted great interest in the quantum chemistry 
calculationi^"— The DMRG is an accurate method for 
investigating quantum many-body systems. It is varia- 
tional and has been applied extensively and successfully 
to the study of strongly correlated electronic materials. 
In 1999, White and Martini made the first DMRG cal- 
culation of the ground state energy of water molecule. 
Within a basis set of 25 Hartree-Fock orbitals, they found 
that the ground state energy by the DMRG already con- 
verges to the exact result obtained from the full con- 
figuration interaction^'^ by just keeping 400 many-body 
basis states. It reveals the potential of the DMRG in the 
quantum chemistry calculation. In 2003, Chan and Gor- 
don made a benchmark calculation for the ground state 
energy of water molecule by using 41 Hartree-Fock or- 
bitals and up to 6000 many-body basesJ^ Their result, 
—85.512Eh {Eh is the Hartree unit of energy, the attrac- 
tive energy from nucleus 9.197-E;i is included), is by far 
the most accurate ground state energy of water molecule 
obtained with 41 Hartree-fock orbitals. A comparable 
result was also obtained by Legeza and Solyom.^^ But it 
is still much higher than the experimental value. 



To improve the accuracy, one can increase both the size 
of the one-electron basis set and the number of states 
retained in the DMRG calculation. But this demands 
a dramatic increase of computer resource. By keeping 
6000 states, 41 orbitals are almost the upper limit of one- 
electron basis set that can be handled by the DMRG with 
the currently available computers. In this paper, we will 
show that the accuracy can in fact be more efhciently im- 
proved by optimizing the Hartree-Fock molecular orbitals 
using the DMRG. The idea is that in a real molecular sys- 
tem, the dimension of the Hilbert space is in fact infinite, 
and the Hartree-Fock orbitals are only a few these ba- 
sis states selected by the self-consistent Hartree-Fock ap- 
proximation. This is a single-particle approximation. It 
underestimates the correlation between electrons. Other 
orbitals not including in this Hartree-Fock basis set may 
also have significant contribution to the ground state. 
To include as much as possible these contributions, the 
one-electron orbitals need to be re-orthogonalized using a 
many-body method in a larger Hartree-Fock basis space. 
This re-orthogonalization optimizes the one-electron ba- 
sis set and can be carried out using the DMRG. Using 
41 orbitals optimized from 92 Hartree-Fock orbitals, for 
example, we can get a significantly better result for the 
ground state energy, — 85.558i?h, by just keeping up to 
500 states in the DMRG calculation. This scheme of 
optimization can be naturally integrated in the stan- 
dard DMRG calculation of many-electron systems and 
allows a large basis set to be optimized. This is different 
from the canonical transformationfi^ the complete active 
space self-consistent fieldi^ and other orbital optimiza- 
tion schemes. 



The paper is organized as follows. In Section |TI] we 
present an explicit scheme for the optimizing the single- 
particle Hartree-Fock orbitals. In Section IIIII we take 
the water molecule as an example to test the efficiency 
of the scheme proposed and analyze its advantage. In 
Section IIVI we compare the ground state energy of the 
water molecule obtained by the present scheme with the 
previous results in the literature. Finally, Section |V] is 
devoted to a brief summary and outlook. 
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II. OPTIMIZATION SCHEME 

To do the optimization, one needs first to generate a 
relatively large Hartree-Fock basis set by solving the self- 
consistent Hartree-Fock equations. The DMRG calcula- 
tion, however, is done in a subspace of this basis space. In 
particular, all orbitals will be partitioned into two sets. 
The first contains all active orbitals that will be used 
in the DMRG calculation. The second set, which will 
be taken as a basis reservoir, contains all other orbitals. 
By solving the Hamiltonian with the DMRG in the ac- 
tive orbital space, one can find the one-electron density 
matrix from the ground state wave-function. A set of re- 
orthogonalized orbitals can then be found by diagonaliz- 
ing the one-electron density matrix. From their occupa- 
tion numbers, one can identify the contribution of each 
orbital to the ground state. Both the highest and least 
occupied orbitals contribute less to the correlation effect. 
One can freeze these less important orbitals by swapping 
them with the orbitals in the reservoir. This defines a 
new set of active orbitals. Again these orbitals can be 
re-orthogonalized by performing the DMRG calculation. 
By repeating this procedure many times until and after 
all the orbitals in the reservoir are activated, the orbitals 
in the active space will finally become optimized. 

Below we take a water molecule to show how this 
method works. We start by performing a self-consistent 
Hartree-Fock calculation to find the Hartree-Fock or- 
bitals and the corresponding one- and two-electron 
integralsi^ The experimental values for the bonding an- 
gle between two hydrogens, 104.5 degrees, and the dis- 
tance between hydrogen and oxygen, 0.957 Angstroms, 
are used in the calculation. The Hamiltonian for describ- 
ing a water molecule can then be expressed as 

where {cia) is the creation (annihilation) operator of 
electron at the ith orbital with spin a. tij is the one- 
electron integral. Vijki is the tensor for describing the 
Coulomb interaction between electrons. 

Now we divide the Hartree-Fock basis set into the ac- 
tive orbitals in the space A and the remaining as reservoir 
denoting as the space I. The orbitals in the reservoir are 
either fully occupied or not occupied by electrons if their 
energies are below or above the Fermi level. By freezing 
the orbitals in the reservoir, one can rewrite the Hamil- 
tonian as 

H = Eo+ J2 

ijeA,cT 

+ yi3klc\aC]a'Cl'y'<^ka, (2) 

ijkl^A.crcr' 

where Ei^ is a constant energy contributed from all or- 



bitals in the reservoir 

+ XI %y(4<T'CiT')(c.Lci<T). (3) 

{cl^Cia) = 1 if orbital {i,<j) is below the Fermi level or 
otherwise, i^o = if all the orbitals below the Fermi 
level are included in the active space, tfj is the one- 
electron integral between the active orbitals. It includes 
the contribution from the potential energy between active 
orbitals and frozen ones in the reservoir: 

ttj,a = + J2 (^^'^'^J " "^^kjkSaa') (cL'Cfea'). (4) 
feel.cr' 

The second term in Eq. ^ is difficult to treat in the 
DMRG calculation because it is a sum of 0{N'^) oper- 
ators. It is practically infeasible to calculate and store 
independently all the matrix elements of these operators. 
To overcome this difficulty, the regrouping technique of 
operators proposed by Xiang should be usedfS This can 
reduce the number of independent operators whose ma- 
trix elements need to evaluated from 0{N'^) to the order 
ofO{N'^). 

In the active space A, the Hamiltonian can be diago- 
nalized by the DMRG. From the ground state wavefunc- 
tion obtained, {ip), the single-particle density matrix 

Ay = {i'\4<T(^jM) (5) 

can be evaluated. The eigenvectors of p define a new 
set of orthogonal one-electron basis states, called natu- 
ral orbitals. The eigenvalue of p is the occupation num- 
ber, which measures the probability of the corresponding 
eigenvector in the ground state. The orbitals with the 
highest or lowest occupation number have the least con- 
tribution to the exchange and correlation energy. They 
are less important in comparison with other orbitals. 
Thus by diagonalizing the single-particle density matrix, 
one can optimize the basis states and order them accord- 
ing to their contribution to the many-body ground state. 
This completes the first step of orbital optimization. Af- 
ter that, a few of least important orbitals are swapped 
with the orbitals in the reservoir. The Hamiltonian for 
the active orbitals is then updated. 

The above procedure of optimization can be repeated 
until all the orbitals in the reservoir are activated. This 
completes a full cycle of optimization. Generally a few 
cycles are needed in order to obtain the most optimized 
orbitals. Once the optimized orbitals are determined, 
the DMRG iterations with finite lattice sweeping will be 
performed to find the ground state energy. Below we con- 
sider explicitly the Pople-type bases to test the efficiency 
of the scheme proposed above. 
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FIG. 1. (Color online) The ground state energy of H2O as a 
function of the optimization step for the three sets of Pople- 
type basis states, which contain 47, 28, and 18 Hartree-Fock 
orbitals, respectively. There are 18 orbitals in the active 
space. In the DMRG calculation, M = 128 many-body basis 
states are retained. 

III. TEST OF OPTIMIZATION ALGORITHM 

Figure [T] shows how the ground state energy of water 
molecule varies with the step of optimization for the 18 
active molecular orbitals by the DMRG. Each point in 
the figure represents a cycle of DMRG calculation within 
a set of active obtials. Three sets of Pople-type Hartree- 
Fock bases, 6-311++G(2d, 2p), 6-311+G* and 6-31G*, 
are used. They contain 47, 28, and 18 Hartree-Fock or- 
bitals, respectively. The active space includes all 10 elec- 
trons of H2O. For the basis set 6-31 G* with 18 Hartrce- 
Fock orbitals, all 18 orbitals are used to perform the 
DMRG calculation. In this case, the orbital optimization 
is to recombine the molecular orbitals through the uni- 
tary transformation defined by the single-particle density 
matrix. For the other two cases shown in Fig. [1] there 
are orbital exchanges between active and reservoir spaces. 
At each time 3 least occupied orbitals in the active space 
are swapped with the orbitals in the reservoir. A full 
cycle of optimization needs 4 and 10 times of swapping 
for the systems with 28 and 47 Hartree-Fock orbitals, re- 
spectively. Fig. [T] shows the results for 10 full cycles of 
optimizations of orbitals, and additional 10 times of the 
DMRG sweeping in the optimized active space. 

For all the three cases shown in Fig. [1] the orbital opti- 
mization improves significantly the DMRG results. The 
improvement is more striking at the first cycle of orbital 
optimization. After that, the improvement becomes rel- 
atively small. This is because all orbitals have already 
been activated in the first full cycle of optimization. It 
suggests that in practical application, two to three cycles 
of orbital optimization are enough. 

Another feature revealed by Fig. [1] is that the more 
the Hartree-Fock orbitals are used for optimization, the 
lower (hence better) the ground state energy can be ob- 



FIG. 2. (Color online) The ground state energy of H2O as a 
function of the number of Hartree-Fock orbitals used for op- 
timization. The active space contains 13, 18 and 22 orbitals, 
respectively. In the orbital optimizations, M = 128 states 
are retained. In the calculation of the ground state energy 
from the optimized orbitals using the finite-lattice algorithm 
of DMRG, the number of states retained is also M — 128 ex- 
cept in the last step of iteration where AI = 500 are retained. 



tained. This is natural since a larger basis set involves 
more correlation that is underestimated by the Hartree- 
Fock approximation. To see this more quantitatively, we 
show in Fig. [5] the ground state energy of H2O as a func- 
tion of the number of Hartree-Fock orbitals used for opti- 
mization. For the three sets of data shown in the figure, 
which are obtained with 13, 18, and 22 active orbitals re- 
spectively, the ground state energy varies almost linearly 
with the number of Hartree-Fock orbitals. It indicates 
that the optimization is indeed important. Moreover, 
the time needed for optimization just scales linearly with 
the number of Hartree-Fock orbitals, thus the optimiza- 
tion is quite efficient. Allowing the memory space for 
storing the matrix elements of Vijki , this suggests that as 
many as Hartree-Fock orbitals should be included in the 
optimization. 

The orbital optimization can be also improved by in- 
creasing the number of states retained in the DMRG cal- 
culation M. Fig. [3] shows how the ground state energy 
of H2O varies with the step of optimization by keeping 
M = 32, 64, and 128 states in the DMRG iteration, re- 
spectively. The improvement is indeed quite significant 
when M is increased from 32 to 64, and to 128. But fur- 
ther increasing M, more improvement can be achieved. 
But the speed of improvement will become smaller and 
smaller, since the ground state energy will converge ex- 
ponentially with M for sufficiently large M . If both com- 
puter time and memory space are allowed, the value of 
M used in the optimization should be taken such that 
it is just before the ground state energy begins to con- 
verge exponentially. Having shown the advantage of the 
scheme, we apply it to calculate the ground state energy 
of water molecule and compare it with the results in the 
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FIG. 3. (Color online) The ground state energy of H2O ob- 
tained by the DMRG with 18 active orbitals, optimized from 
6-311-l-G* with 28 Hartree-Fock orbitals. A/ is the number of 
states retained in the DMRG calculations. 



literature. 
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find that this variational bound can be significantly low- 
ered by keeping a iew hundred basis states in the DMRG 
calculation. Fig. U shows the DMRG results for the 
ground state energy with 41 orbitals, optimized from 92 
and 172 Hartree-Fock orbitals, respectively. By keeping 
just 128 states in the DMRG calculation, we find that 
the result is already better than that obtained by Chan 
and Gordon. In the last step of DMRG calculation, the 
number of states retained is increased from 128 to 500. 
This leads to a sharp drop in the data, further lower- 
ing the energy by about 0.05Eh- This result shows the 
potential of orbital optimization in quantum chemistry 
calculations, since the computer cost in obtaining these 
results is much smaller than in the calculation of Chan 
and Gordon.^- 

To further improve the result, we calculate the ground 
state energy of H2O by increasing the size of active space 
to 61 orbitals, optimized from 172 Hartree-Fock orbitals. 
By keeping 300 states at the last step of DMRG iterations 
and 150 states in all other steps, we find that ground 
state energy is — 85.567(i?;i) which, as shown in Tab. HI 
is comparable to the best quantum Monte Carlo result 
as well as the coupled cluster expansion results obtained 
from 92 orbitals. But our result is variational. 



TABLE I. Comparison of the ground state energy of H2O 
obtained by different methods. Our DMRG result is obtained 
by using 61 active orbitals optimized from 172 Hartree-Fock 
orbitals. In all the iteration steps of DMRG, except the last 
one, M = 150 states are retained. In the last step, 300 states 
are retained. 



Method 



Number of orbitals Energy (Eh) 



HF 

CCSD(T) 
QMC (Ref. [17]) 
DMRG (Ref. [10]) 
DMRG (present work) 



92 
92 
92 
41 
61 



-85.256 
-85.563 
-85.567 
-85.512 
-85.567 



SUMMARY AND OUTLOOK 



FIG. 4. (Color online) The ground state energy of H2O ob- 
tained with 41 active orbitals, optimized from 92 and 172 
Hartree-Fock orbitals, respectively. M — 128 states are re- 
tained in the DMRG calculations, except at the final step 
at which 500 states are retained. The dash line is the best 
result of Chan and Gondon, obtained using 41 orbitals and 
M = 6000 states.^ 

The best DMRG result for the ground state energy 
of water molecule so far available is that obtained by 
Chan and Gordon in 2003, by using 41 Hartree-Fock 
orbitals and keeping M = 6000 states-^. Their value, 
— 76.314715(i?;i), sets a variational bound for the ground 
state energy of H2O. However, by taking 41 active or- 
bitals optimized from a larger Hartree-Fock basis set, we 



In this paper we have shown that the orbital opti- 
mization is important in the quantum chemistry calcu- 
lation. We present a novel DMRG scheme to optimize 
the Hartree-Fock orbitals. It allows more than 100 or- 
bitals to be treated and improves greatly the accuracy 
of the results. With 41 optimized orbitals and 128 basis 
states, our DMRG result for the ground state energy of 
H2O is already better than that reported by Chan and 
GordoniS with 41 HF orbitals and 6000 states. We find 
that the ground state energy is -85.567£';i by using 61 
optimized orbitals. This result is comparable to the best 
values reported by the CCSD(T) and quantum Monte 
Carlo calculations with 92 Hartree-Fock orbitals. It can 
be further improved by optimizing orbital orders^ii These 
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optimized orbitals can be used not just by the DMRG, 
but also by other many-body numerical methods. 
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